Skip to content

feat(cli): migrate provider authoring surface - #1714

Merged
christso merged 2 commits into
mainfrom
feat/provider-cli-surface
Jul 7, 2026
Merged

feat(cli): migrate provider authoring surface#1714
christso merged 2 commits into
mainfrom
feat/provider-cli-surface

Conversation

@christso

@christso christso commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

AgentV's authored provider surface now uses the Promptfoo-aligned provider vocabulary consistently across the CLI, config discovery, docs, and examples. Users select configured providers with --provider / --providers, authored catalogs resolve from providers.yaml, and target-era authored inputs hard-error with migration guidance instead of silently falling back.

This intentionally does not change generated run-bundle artifact filenames. Bundle output still writes the existing targets.yaml artifact path so av-kfik.51 can own that artifact migration without this branch preserving or copying legacy bundle files.

What Changed

  • Provider catalog discovery now prefers providers.yaml / .agentv/providers.yaml and hard-rejects authored targets.yaml files.
  • Eval, bundle, pipeline, and prepare command surfaces expose provider flags while old target flags report hard-deprecation diagnostics.
  • Init/create/interactive output, current docs, README, and examples now describe authored provider config with providers, label, and id semantics.
  • Example provider catalogs were renamed from targets.yaml to providers.yaml where they are authored inputs.

Validation

  • bun test apps/cli/test/commands/eval/run-command-options.test.ts apps/cli/test/commands/eval/targets.test.ts apps/cli/test/commands/eval/bundle.test.ts apps/cli/test/commands/prepare/prepare.test.ts apps/cli/test/commands/grade/grade-prepared.test.ts apps/cli/test/eval.integration.test.ts packages/core/test/evaluation/providers/targets-file.test.ts
  • bun run validate:examples
  • bun --filter agentv typecheck
  • bunx @biomejs/biome@1.9.4 check on changed TS/JS/MD/JSON files
  • git diff --check

Post-Deploy Monitoring & Validation

No additional operational monitoring required. This is a CLI/docs/config migration with no hosted runtime path; GitHub Actions and downstream CLI smoke usage are the relevant validation surfaces.

Related

Related: av-kfik.52


Compound Engineering
GPT-5

@cloudflare-workers-and-pages

cloudflare-workers-and-pages Bot commented Jul 7, 2026

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: a72c2ac
Status: ✅  Deploy successful!
Preview URL: https://16fc35b6.agentv.pages.dev
Branch Preview URL: https://feat-provider-cli-surface.agentv.pages.dev

View logs

@christso
christso force-pushed the feat/provider-cli-surface branch from d9c9da8 to a72c2ac Compare July 7, 2026 04:20
@christso
christso marked this pull request as ready for review July 7, 2026 04:23
@christso
christso merged commit a708e59 into main Jul 7, 2026
9 checks passed
@christso
christso deleted the feat/provider-cli-surface branch July 7, 2026 04:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant